Application No. 09/870,698 
Amendment dated August 6, 2004 
Reply to Office Action of May 7, 2004 

I. Listing of Claims 

This listing of Claims replaces without prejudice all prior versions and 
listing of Claims in the application. 

1 . (Currently Amended) A method of determining the position of an object relative to a 
rectangular reference frame from captured images of the object based on multiple 
triangulation results, the captured images being taken by at least two pair of cameras at 
the corners of said reference frame having fields of view encompassing said reference 
frame, at le ast on e each of said cameras having an offset angle caus i ng resulting in an 
extremity of the field of view thereof to e xt e nd extending beyond a boundary of said 
reference frame, said method comprising the steps of: 

capturing an image of the object using each camera of said at least two 
pair at at least one location within said reference frame; 

for each location: 

determining the position of the object within each captured image 
and for each captured image placing the determined position into a coordinate system 
corresponding to that of said reference frame , wherein the determined position of the 
object within each image is represented by an angle <f> . said angle being egual to the 

angle formed between the extremity of the field of view extending beyond the reference 
frame boundary and a line extending from the camera that intersects the object within 
the image : and 

processing the determined positions to determine the position of the 
object at each location and the offset angle of said at least one camera , wherein during 
said processing each said angle d> is converted to an angle ox said angle co being 

represented by: 

co-a-8 

where: 

5 is the camera offset angle: and 
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a is equal to the angle <fr with the camera offset angle removed and 

referenced to the v-axis of the reference frame coordinate system and wherein each 
said angle co is fitted to the equation: 


co = arctan 

w cam 


X cam X i 


y cam y i 


where: 


x ram and Vr, flm are the rectangular coordinates of the camera: and 


Xiand Vi^are the rectangular coordinates of the object, thereby to yield the 
rectangular position (x^ Vi ) and the camera offset angle . 


2. Cancelled. 

3. Cancelled . 

4. Cancelled. 

5. (Currently Amended) The method of claim [4] 1 wherein the fitting is performed 
using a linearization technique. 

6. (Original) The method of claim 5 wherein said linearization technique is the Moore- 
Penrose pseudo-inverse method. 


7. (Currently Amended) A method of determining the position of an object relative to a 
reference frame from captured images of the object based on multiple triangulation 
results, the captured images being taken by at least two pair of cameras having fields of 
view encompassing the reference frame, an extremity of the field of view of each 
camera encompassing a boundary of said reference frame, at least one of said 
cameras being offset causing the extremity of the field of view thereof to extend beyond 
said boundary, the offset defining an offset angle, said method comprising the steps of: 


3 of 13 

Doc #:WAS01 (204694-00070) 41 558482v1;08/06/2004/Time: 14:36 


Application No. 09/870,698 
Amendment dated August 6, 2004 
Reply to Office Action of May 7, 2004 

determining the position of the object within each image, the position of 
the object within each image being represented by an angle, said angle being equal to 
the angle formed between the extremity of the field of view of the camera that acquired 
the image and a line extending from that camera that intersects the object within the 
image; 

determining the offset angle for each offset camera; 

for each offset camera subtracting the offset angle from the angle 
representing the position of the object within the image taken by said offset camera to 
calibrate the angle; and 

for each pair of cameras using the calibrated angles to calculate the 
position of the object with respect to the reference frame using triangulation. 

8. (Previously Presented) The method of claim 7 wherein two or more of said cameras 
are offset. 

9. (Previously Presented) In a touch system including at least two pair of cameras and 
a processor to process images acquired by said at least two pair cameras, where the 
position of an object that is within the fields of view of said cameras relative to a 
reference frame is determined by triangulating object position data in images acquired 
by the cameras of each pair, a method of calibrating the touch system comprising the 
steps of: 

determining an offset angle of each camera relative to the reference 
frame, said offset angle representing the degree by which the field of view of the 
camera extends beyond said reference frame; 

for each camera, using the offset angle to calibrate the object position 
data developed from the image acquired by that camera; and 

using the calibrated object position data during triangulation for each pair 
of cameras to determine the position of said object relative to said reference frame. 
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10. (Previously Presented) In a touch system including a reference frame, and at least 
two pair of cameras having fields of view that encompass said reference frame, wherein 
the position of an object relative to the reference frame is determined from captured 
images of the object based on multiple triangulation results, and wherein the fields of 
view of at least some of said cameras are rotated with respect to the coordinate system 
of said reference frame to define offset angles, a method of calibrating said touch 
system comprising the steps of: 

capturing an image of the object using each camera of said at least two 
pair at at least one location within said reference frame; and 

for each location: 

determining the position of the object within each captured image, 
the position of the object within each captured image being represented by an angle <f> % 
said angle being equal to the angle formed between an extremity of the field of view of 
the camera that acquired the image extending beyond the reference frame and a line 
extending from that camera that intersects the object within the image; and 

mathematically calculating the offset angles of the cameras having 
rotated fields of view based on the angle determined for each image and the position of 
the cameras relative to the coordinate system assigned to said reference frame. 

1 1 . (Original) The method of claim 1 0 wherein the offset angle of each camera is 
calculated using a least squares method. 

12. (Previously Presented) A touch system comprising: 

a generally rectangular reference frame surrounding a touch surface, one 
corner of the reference frame defining the origin of a coordinate system assigned to 
said touch surface; 

a camera adjacent each corner of the reference frame, each camera 
being aimed towards said touch surface and capturing images of said touch surface 
within the field of view thereof, fields of view of said cameras overlapping within said 
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reference frame, the fields of view of said cameras being offset with respect to said 
reference frame; and 

a processor processing the captured images and generating object 
position data when an object appears in images, said processor determining the 
position of said object relative to said origin in rectangular coordinates using said object 
position data based on multiple triangulation results, wherein said processor further 
executes a calibration routine to determine offset angles of said cameras, said offset 
angles being used by said processor to adjust said object position data thereby to align 
said multiple triangulation results prior to said position determination. 

13. Cancelled. 

14. (Previously Presented) The method of claim 8 wherein the offset angle for each 
offset camera is determined using a least squares method. 

15. (Previously Presented) The method of claim 8 wherein said at least two pair of 
cameras include at least three cameras, each camera being located adjacent a different 
corner of said reference frame. 

16. (Previously Presented) The method of claim 9 wherein the offset angle for each 
offset camera is determined using a least squares method. 

17. (Previously Presented) The method of claim 9 wherein said at least two pair of 
cameras include at least three cameras, each camera being located adjacent a different 
corner of said reference frame. 

18. (Previously Presented) The method of claim 10 wherein during said processing 
each said angle is converted into a rectangular (Xj,yj) position within the reference frame 
coordinate system. 
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19. (Previously Presented) The method of claim 18 wherein captured images are 
acquired by cameras at the corners of a rectangular reference frame, each of said 
cameras having a field of view offset with respect to said reference frame, during said 
processing each said angle <f> being converted to an angle o>, said angle co being 

represented by: 

co -a - 8 

where: 

S is the camera offset angle; and 

a is equal to the angle ^ with the camera offset angle removed and 
referenced to the y-axis of the reference frame coordinate system and wherein each 
said angle co is fitted to the equation: 


co — arctan 

cam 


X cam X i 


yearn y i 


where: 

Xcam and y C am are the rectangular coordinates of the camera; and 
Xj and yi are the rectangular coordinates of the object, thereby to yield the 
rectangular position (x^ y) and the camera offset angle. 


20. (Previously Presented) The method of claim 19 wherein the fitting is performed 
using a linearization technique. 

21. (Previously Presented) The method of claim 19 wherein said linearization 
technique is the Moore-Penrose pseudo-inverse method. 

22. (Previously Presented) A touch system according to claim 12 wherein said 
processor determines the offset angles using a least squares method. 


23. (Previously Presented) A touch system comprising: 
a substantially rectangular touch surface; 
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imaging devices mounted adjacent at least three corners of said touch 
surface to define at least two triangulation pair of imaging devices, each imaging device 
having a field of view looking across said touch surface, said imaging devices being 
oriented to capture overlapping images of said touch surface; and 

at least one processing device processing captured images to determine 
the position of at least one pointer appearing in the captured images based on multiple 
triangulation results, the fields of view of said imaging devices being calibrated by said 
at least one processing device prior to determining the position of the at least one 
pointer thereby to align said multiple triangulation results. 

24. (Previously Presented) A touch system according to claim 23 comprising an 
imaging device at each corner of said touch surface to define at least four triangulation 
pair of imaging devices. 

25. (Previously Presented) A touch system according to claim 23 wherein during said 
calibration, said at least one processing device determines the degree by which the 
field of view of each imaging device extends beyond the boundary of said touch 
surface. 

26. (Previously Presented) A touch system according to claim 25 wherein the degree 
by which the field of view of each imaging device extends beyond the boundary of said 
touch surface is determined using a least squares method. 

27. (Previously Presented) A user input system comprising: 

at least two pair of imaging devices having overlapping fields of view 
oriented to capture images of a region of interest in which at least one pointer can be 
positioned; and 

at least one processing device processing pointer data extracted from the 
captured images acquired by the imaging devices using triangulation to yield a 
triangulation result for each pair of imaging devices thereby to determine the position of 
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said at least one pointer within said region of interest, said at least one processing 
device adjusting the pointer data prior to processing to compensate for fields of view of 
imaging devices that extend beyond the periphery of said region of interest thereby to 
align the triangulation results. 

28. (Currently Amended) A touch user input system according to claim 27 wherein the 
degree by which the field of view of each imaging device extends beyond the boundary 
of said touch surface is determined using a least squares method. 

29. (Currently Amended) A touch user input system according to claim 27 wherein 
said region of interest encompasses a touch surface. 

30. (Currently Amended) A touch user input system according to claim 29 wherein 
said at least two pair of imaging devices include at least three imaging devices, each 
being located adjacent a different corner of said touch surface. 

31. (New) A touch system according to claim 25 wherein the pointer in each image is 
represented by an angle <f> y each angle <p being equal to the angle formed between the 
extremity of the field of view extending beyond the touch surface and a line extending 
from the imaging device that intersects the pointer and wherein said at least one 
processing device converts each said angle <f> to an angle co, said angle cd being 

represented by: 

co = a-S 

where: 

8 is an imaging device offset angle representing the degree by which the 
field of view of the imaging device extends beyond said boundary; and 

a is equal to the angle 0 with the imaging device offset angle removed 
and referenced to the y-axis of the touch surface coordinate system and wherein each 
said angle co is fitted to the equation: 
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=arctan 


'cam 


X cam X i 


y cam y i 


where: 

Xcam and ycamare the rectangular coordinates of the imaging device; and 
Xj and ys are the rectangular coordinates of the pointer, thereby to yield the 
rectangular position (Xj.yj) and the imaging device offset angle. 

32. (New) A touch system according to claim 31 wherein said at least one processing 
device uses a linerization technique to fit each said angle g> to the equation. 

33. (New) A user input system according to claim 29 wherein the pointer in each 
image is represented by an angle ^ , each angle <f> being equal to the angle formed 
between the extremity of the field of view extending beyond the touch surface and a line 
extending from the imaging device that intersects the pointer and wherein said at least 
one processing device converts each said angle <f> to an angle co, said angle o being 

represented by: 

co-a-8 

where: 

8 is an imaging device offset angle representing the degree by which the 
field of view of the imaging device extends beyond said boundary; and 

a is equal to the angle <j> with the imaging device offset angle removed 
and referenced to the y-axis of the touch surface coordinate system and wherein each 
said angle co is fitted to the equation: 


co = arctan 

cam 


X cam X i 


_ yearn y i 


where: 

Xcam and ycamare the rectangular coordinates of the imaging device; and 
Xjand yjare the rectangular coordinates of the pointer, thereby to yield the 
rectangular position (x^y) and the imaging device offset angle. 
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34. (New) A user input system according to claim 33 wherein said at least one 
processing device uses a linerization technique to fit each said angle co to the equation. 

35. (New) A user input system according to claim 29 comprising an imaging device at 
each corner of said touch surface to define at least four triangulation pair of imaging 
devices. 

36. (New) A user input system according to claim 35 wherein the pointer in each 
image is represented by an angle <f>, each angle ^ being equal to the angle formed 
between the extremity of the field of view extending beyond the touch surface and a line 
extending from the imaging device that intersects the pointer and wherein said at least 
one processing device converts each said angle <f> to an angle co, said angle co being 

represented by: 

co = a - 8 

where: 

S is an imaging device offset angle representing the degree by which the 
field of view of the imaging device extends beyond said boundary; and 

a is equal to the angle <j> with the imaging device offset angle removed 

and referenced to the y-axis of the touch surface coordinate system and wherein each 
said angle co is fitted to the equation: 


co — arctan 

cam 


X cam X i 


y cam y i 


+S 

cam 


where: 

Xcam and y C amare the rectangular coordinates of the imaging device; and 
Xj and yj are the rectangular coordinates of the pointer, thereby to yield the 
rectangular position (Xj, yj) and the imaging device offset angle. 


37. (New) A user input system according to claim 36 wherein said at least one 
processing device uses a linerization technique to fit each said angle co to the equation. 
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